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Abstract 

We consider a simple model of imprecise comparisons: there exists some <5 > 0 such that 
when a subject is given two elements to compare, if the values of those elements (as perceived 
by the subject) differ by at least J, then the comparison will be made correctly; when the two 
elements have values that are within <5, the outcome of the comparison is unpredictable. This 
model is inspired by both imprecision in human judgment of values and also by bounded but 
potentially adversarial errors in the outcomes of sporting tournaments. 

Our model is closely related to a number of models commonly considered in the psychophysics 
literature where S corresponds to the just noticeable difference unit (JND) or difference threshold. 
In experimental psychology, the method of paired comparisons was proposed as a means for 
ranking preferences amongst n elements of a human subject. The method requires performing 
all ( 2 ) comparisons, then sorting elements according to the number of wins. The large number 
of comparisons is performed to counter the potentially faulty decision-making of the human 
subject, who acts as an imprecise comparator. 

We show that in our model the method of paired comparisons has optimal accuracy, min¬ 
imizing the errors introduced by the imprecise comparisons. However, it is also wasteful, as 
it requires all ( 2 ). We show that the same optimal guarantees can be achieved using 
comparisons, and we prove the optimality of our method. We then explore the general trade¬ 
off between the guarantees on the error that can be made and number of comparisons for the 
problems of sorting, max-finding, and selection. Our results provide strong lower bounds and 
close-to-optimal solutions for each of these problems. 


* A preliminary version of this work containing weaker forms of some of the results has appeared in the proceedings 
of 36th International Colloquium on Automata, Languages and Programming (ICALP) 2009. 

Rart of this work was done while the author was at Google Research, Israel. 

^Supported by NSF grant CCF-0832797. Part of this work was done while the author was at IBM Research - 
Almaden. 
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1 Introduction 


Let xi ,... ,Xn be n elements where each Xi has an unknown value val(xi). We want to find the 
element with the maximum value using only pairwise comparisons. However, the outcomes of 
comparisons are imprecise in the following sense. For some hxed <5 > 0, if |val(xi) — val(xj)| < 6, 
then the result of the comparison can be either “>” or “<”. Otherwise, the result of the comparison 
is correct. It is easy to see that in such a setting it might be impossible to find the true maximum 
(for example when the values of all the elements are within <5). It might however be possible to 
identify an approximate maximum, that is an element Xj* such that for all Xj, val(xj) — val(xj*) < k6 
for some, preferably small, value k. In addition, our goal is to minimize the number of comparisons 
performed to find Xj*. We refer to the minimum value k such that an algorithm’s output is always 
guaranteed to be k6-close to the maximum as the error of the algorithm in this setting. Similarly, 
to sort the above elements with error k we need to hnd a permutation tt such that if 7r(z) < 7r(j) 
then val(xj) — val(xj) < k5. 

A key issue that our work addresses is that in any sorting (or max-finding) algorithm, errors 
resulting from imprecise comparisons might accumulate, causing the final output to have high error. 
Consider, for example, applying the classical bubble sort algorithm to a list of elements that are 
originally sorted in the reverse order and where the difference between two adjacent elements is 
exactly 5. All the comparisons will be between elements within 6 and therefore, in the worst case, the 
order will not be modihed by the sorting, yielding error (n —1)5. Numerous other known algorithms 
that primarily optimize the number of comparisons can be easily shown to incur a relatively high 
error. As can be easily demonstrated fTheorem 13.ip . performing all ( 2 ) comparisons then sorting 
elements according to the number of wins, a “round-robin tournament”, achieves error k = 2, 
which is lowest possible fTheorem 13.2p . A natural question we ask here is whether ( 2 ) comparisons 
are necessary to achieve the same error. We explore the same question for all values of k in the 
problems of sorting, max-finding, and general selection. 

One motivation for studying this problem comes from social sciences. A common problem both 
in experimental psychology and sociology is to have a human subject rank preferences amongst 
many candidate options. It also occurs frequently in marketing research m Chapter 10], and 
in training information retrieval algorithms using human evaluators [U Section 2.2]. The basic 
method to elicit preferences is to present the subject two alternatives at a time and ask which is 
the preferred one. The common approach to this problem today was presented by Thurstone as 
early as 1927, and is called the “method of paired comparisons” (see [9] for a thorough treatment). 
In this method, one asks the subject to give preferences for all pairwise comparisons amongst n 
elements. A ranked preference list is then determined by the number of “wins” each candidate 
element receives. A central concept in these studies introduced as far back as the 1800s by Weber 
and Fechner is that of the just noticeable difference (JND) unit or difference threshold A. If two 
physical stimuli with intensities x < y have y < x + Ax, a human will not be able to reliably 
distinguish which intensity is greater. The idea was later generalized by Thurstone to having 
humans not only compare physical stimuli, but also abstract concepts [28]. By the Weber-Fechner 
law, stimuli with intensities x and y cannot be distinguished when 1/(1-|-A) < x/y < 1-|-A. This is 
equivalent to saying that intensities are indistinguishable when the absolute difference between the 
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natural logarithms of the intensities is less than 6 = ln(l + A). Therefore JND in the Weber-Fechner 
law corresponds to the imprecision 5 of our model of comparisons when intensities are measured 
on the logarithmic scale. More generally, we can always assume that the intensities are measured 
on the scale for which JND corresponds to an absolute difference between values. 

Most previous work on the method of paired comparisons has been through the lens of statistics. 
In such work the JND is modeled as a random variable and the statistical properties of Thurstone’s 
method are studied [9] . Our problem corresponds to a simplified model of this problem which does 
not require any statistical assumptions and is primarily from a combinatorial perspective. 

Another context that captures the intuition of our model is that of designing a sporting tour¬ 
nament based on win/lose games. There, biases of a judge and unpredictable events can change 
the outcome of a game when the strengths of the players are close. Hence one cannot necessarily 
assume that the outcome is truly random in such a close call. It is clear that both restricting the 
influence of the faulty outcomes and reducing the total number of games required are important in 
this scenario, and hence exploring the tradeoff between the two is of interest. For convenience, in 
the rest of the paper we often use the terminology borrowed from sporting tournaments. 

Accordingly, the problems we consider have a natural interpretation as problems on a tourna¬ 
ment graph (that is, a complete directed graph with only one edge between any two vertices). We 
can view all the comparisons that were revealed by the comparator as a digraph G. The vertices of 
G are the n elements and it contains the directed edge {xi, Xj) if and only if a comparison between 
Xi and Xj has been made, and the comparator has responded with “x, > Xj”. At any point in time 
the comparison graph is a subgraph of some unknown tournament graph. The problem of finding 
a maximum element with error k is then equivalent to finding a vertex in such a graph from which 
there exists a directed path of length at most k to any other vertex while minimizing the number 
of edges which need to be revealed (or “matches” in the context of tournaments). Such vertex is 
referred to as a k-king (or just king for k = 2) |19l I21j . Existence and properties of such elements 
for various tournament graphs have been studied in many contexts. Sorting with error k gives an 
ordering of vertices such that if vertex Xi occurs after Xj in the order then there exists a directed 
path of length at most k from Xi to Xj. The connection to tournament graphs is made explicit in 
Section [5l 

Finally, in a number of theoretical contexts responses are given by an imprecise oracle. For 
example, for weak oracles given by Lovasz in the context of optimization [20] and for the statistical 
query oracle in learning m the answer of the oracle is undefined when some underlying value 2 : is 
within a certain small range of the decision boundary. When z itself is the difference of two other 
values, say zi and Z 2 , then oracle’s answer is, in a way, an imprecise comparison of zi and Z 2 - This 
correspondence together with our error 2 sorting algorithm was used by one of the authors to derive 
algorithms in the context of evolvability m- 

1.1 Our results 

We first examine the simpler problem of finding only the maximum element. For this problem, we 
give a deterministic max-finding algorithm with error 2 using 2n^/^ comparisons. This contrasts 
with the method of paired comparisons, which makes (re^ — n)j2 comparisons to achieve the same 
error. Using our algorithm recursively, we build deterministic algorithms with error k that require 
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^-1)) comparisons. We also give a lower bound of comparisons for the 

problem. The bounds are almost tight — the upper bound for our error k algorithm is less than 
our lower bound for error {k — 1) algorithms. We also give a linear-time randomized algorithm that 
achieves error 3 with probability at least 1 — 1/n^, showing that randomization greatly changes the 
complexity of the problem. 

We then study the problems of selecting an element of a certain order and sorting. For k = 2, 
we give a deterministic algorithm that sorts using comparisons (and in particular can be used 
for selecting an element of any order). For general k, we show that selection of an element of any 
order i can be achieved using 0(2^ • comparisons and sorting with error k can performed 

using 0(4^ • comparisons. 

We give a lower bound of comparisons for sorting with error k. When k = 0(1) our 

bounds are tight up to a constant factor and are at most a logn factor off for general k. Our lower 
bounds for selection depend on the order of the element that needs to be selected and interpolate 
between the lower bounds for max-finding and the lower bounds for sorting. For k > 3, our lower 
bound for finding the median (and also for sorting) is strictly larger than our upper bound for 
max-finding. For example, for k = 3 the lower bound for sorting is n(n^/^), whereas max-finding 
requires only 0(n®/^) comparisons. 

Note that we achieve log logn error for max-finding in 0(n) comparisons, and log logn error 
for sorting in O(nlog^n) comparisons. Standard methods using the same number (up to a logn 
factor) of comparisons (e.g. a single-elimination tournament tree, or Mergesort) can be shown to 
incur error at least logn. Also, all the algorithms we give are efficient in that their running times 
are of the same order as the number of comparisons they make. 

The basis of our deterministic algorithms for both max-finding and selection are efficient al¬ 
gorithms for a small value oi k {k = 2). The algorithms for larger error k use several different 
ways to partition elements, then recursively use algorithms for smaller error and then combine 
results. Achieving nearly tight results for max-finding requires in part relaxing the problem to that 
of finding a small k-max-set, or a set which is guaranteed to contain at least one element of value 
at least x* — k5, where x* is the maximum value of an element (we interchangeably use x* to refer 
to an element of maximum value as well). It turns out we can find a fe-max-set in a fewer number 
of comparisons than the lower bound for error-A: max-finding algorithms. Exploiting this allows 
us to develop an efficient recursive max-finding algorithm. We note a similar approach of finding 
a small set of “good” elements was used by Borgstrom and Kosaraju [7] in the context of noisy 
binary search. 

To obtain our lower bounds for deterministic algorithms we show that the problems we consider 
have equivalent formulations on tournament graphs in which the goal is to ensure existence of 
short (directed) paths from a certain node to other nodes. Using a comparison oracle that always 
prefers elements that had fewer wins in previous rounds, we obtain bounds on the minimum of 
edges that are required to create the paths of desired length. Such bounds are then translated 
back into bounds on the number of comparisons required to achieve specific error guarantees for 
the problems we consider. 

For our randomized max-finding algorithm, we use a type of tournament with random seeds 
at each level, in combination with random sampling at each level of the tournament tree. By 
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Task 

Upper bounds 

Lower bound 

k = 2 

k 

k = log log n 

Find maximum 

2 n ^/2 

0(ni+i/(3-2"-^-i)) 

0{n) 

H(ni+V( 2 ^-i)) 

Select z-th 

4j.j3/2 

0 ( 2 fc.ni+V 2 *-^) 

0{n log n) 

H(z • maxlz^/^^*'”^^ ^^}) 

Sort 

4 ^ 3/2 

0 ( 4 fc. ^ 1 + 1 / 2 -^) 

0 (n log^ n) 

j^(^l+l/ 2 -^) 


Table 1: Overview of the bounds for deterministic algorithms with error k. In the selection task 1-th smallest 
element is chosen (with maximum being n-th smallest). 


performing a round-robin tournament on the top few tournament players together with the sampled 
elements, we obtain an element of value at least x* — 36 with polynomially small error probability. 

1.2 Related Work 

Handling noise in binary search procedures was first considered by Renyi [21] and by Ulam [29| . An 
algorithm for solving Ulam-Renyi’s game was proposed by Rivest et al. [25], where an adversarial 
comparator can err a bounded number of times. They gave an algorithm with query complexity 
O(logn) which succeeds if the number of adversarial errors is constant. 

Yao and Yao m introduced the problem of sorting and of hnding the maximal element in a 
sorting network when each comparison gate either returns the right answer or does not work at all. 
For finding the maximal element, they showed that it is necessary and sufficient to use (e+l)(n — 1) 
comparators when e comparators can be faulty. Ravikumar, Ganesan and Lakshmanan extended 
the model to arbitrary errors, showing that 0{en) comparisons are necessary and sufficient [23]. 
For sorting, Yao and Yao showed that 0(n log n + en) gates are sufficient. In a different fault model, 
and with a different definition of a successful sort, Finocchi and Italiano m showed an O(nlogn) 
time algorithm resilient to (nlogn)^/^ faults. An improved algorithm handling (nlogn)^/^ faults 
was later given by Finocchi, Grandoni and Italiano |12j . 

In the model where each comparison is incorrect with some probability p, Feige et al. [10] and 
Assaf and Upfal [3] give algorithms for several comparison problems, and mm give algorithms for 
binary search. We refer the reader interested in the rich history and models of faulty comparison 
problems to a survey of Pelc [ 22 ] and a monograph of Cicalese [ 8 ] . 

We point out that some of the bounds we obtain appear similar to those known for max-finding, 
selection, and sorting in parallel in Valiant’s model [30]. In particular, our bounds for max-finding 
are close to those obtained by Valiant for the parallel analogue of the problem (with the error used 
in place of parallel time) [30] . and our lower bound of for max-finding with error k 

is identical to a lower (and upper) bound given by Haggkvist and Hell [IB] for merging two sorted 
arrays each of length n using a /c-round parallel algorithm. Despite these similarities in bounds, 
our techniques are different, and we are not aware of any deep connections. As some evidence of 
the difference between the problems we note that for sorting in k parallel rounds it is known that 
H(n^'’'^/^) comparisons are required [3161 [IS], whereas in our model, for constant k, we can sort 
with error k in 77 , 1 + 1 / 2 ®^'“^ comparisons. For a survey on parallel sorting algorithms, the reader is 
referred to M- 


5 
















The authors have recently learned that finding a king and sorting kings in a tournament graph 
while minimizing the number of uncovered edges was previously studied by Shen, Sheng and Wu [26]. 
As follows from our results, this problem is equivalent to max-finding and sorting by a deterministic 
algorithm with error 2. Their upper and lower bounds for this case are (asymptotically) identical 
to our bounds and are based on essentially the same techniques. Our results can be seen as 
a generalization of their results to A:-kings for all A: > 2. We also remark that for randomized 
algorithms our problem is no longer equivalent to the problem considered in |26j . 

2 Notation 

Throughout this document we let x* denote some Xi of the maximum value (if there are several 
such elements, we choose one arbitrarily). Furthermore, we use Xi interchangeably to refer to the 
both the element and its value, e.g. Xi > xj should be interpreted as val(a:j) > val(xj). 

We assume <5 = 1 without loss of generality, since the problem with arbitrary 5 > 0 is equivalent 
to the problem with 5 = 1 and input values Xi/6. We stress that the algorithm does not know 6. 

We say x defeats y when the comparator claims that x is larger than y (and we similarly use 
the phrase y loses to x). Note that x defeats y implies x > y — 1. We do not necessarily assume 
that repeating the same comparison several times would give the same result, and our algorithms 
do not repeat a comparison twice. We say x is k-greater than y {x >k y) x > y — k. The term 
k-smaller is defined analogously. A set of elements T is /c-greater than a set of elements S if for 
every y G S and every x G T, x >k y- We say an element is a k-max of a set if it is A:-greater than 
all other elements in the set. If the set is not specified explicitly then we refer to the set of all input 
elements. A permutation Xjr(i), ■ ■ ■ ,a; 7 r(n) is k-sorted if for every i > j. A k-max-set 

is a subset of all elements which contains at least one element of value at least x* — k. 

All logarithms throughout this document are base-2. For simplicity of presentation, we occa¬ 
sionally omit floors and ceilings and ignore rounding errors when they have an insignificant effect 
on the bounds. 

3 Max-Finding 

In this section we give deterministic and randomized algorithms for max-finding. 

3.1 Deterministic Algorithms 

We start by showing that the method of paired comparisons provides an optimal error guarantee, 
not just for max-finding, but also for sorting. 

Theorem 3.1 Sorting according to the number of wins in a round-robin tournament has error at 
most 2. 

Proof. Let x,y he arbitrary elements with y strictly less than x — 2. For any z that y defeats, x 
also defeats z. Furthermore, x defeats y, and thus x has strictly more wins than y, implying y is 
placed lower in the sorted order. ■ 
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Algorithm 2-MaxFind: // Returns an element of value at least x*—2. The value 
s > 1 is a parameter which is by default \^/n] when not specified. 

1. Label all x, as candidates. 

2. while there are more than s candidate elements; 

(a) Pick an arbitrary snbset of s of the candidate elements and play them in a 
round-robin tournament. Let x be the element with the largest number of wins. 

(b) Compare x against all candidate elements and eliminate all elements that lose 
to X. 

3. Play the remaining (at most s) candidate elements in a round-robin tournament and 
return the element with the largest number of wins. 


Figure 1: The algorithm 2-MaxFind for finding a 2-max. 


Theorem 3.2 No deterministic max-finding algorithm has error less than 2. 

Proof. Given three elements a, b, c, the comparator can claim a > b > c > a, making the elements 
indistinguishable. Without loss of generality, suppose A outputs o. Then the values could be a = 0, 
6 = 1, c = 2, implying A has error 2. ■ 

In Figured] we give our error 2 algorithm for max-finding. 

Lemma 3.3 For every s < n, the max-finding algorithm 2-MaxFind has error 2 and makes at most 
{n — s)s-\- (n^ — s^) /(s — 1) comparisons. In particular, the number of comparisons is at most 2v?l’^ 
for 5=1" ^/n]. 

Proof. We first analyze the number of comparisons. In the iteration, the number of comparisons 
is at most ( 2 ) + {nt — s), where nt is the number of candidate elements in round t. We now bound 
the number of iterations and nt. In all but the last iteration, the total number of comparisons 
made in the round-robin tournament is ( 2 ) = s(s — l)/2. Thus by an averaging argument, the 
element which won the largest number of comparisons won at least (s — l)/2 times. Thus, at least 
(s — l)/2 elements are eliminated in each iteration, implying the number of iterations is at most 
2(n — s)/(s — 1) and nt <n — t{s — l)/2. The total number of comparisons is thus at most 

[s(s — l)/2 -\- n — t{s — l)/2] < (n — s)s -\- (n^ — s^)/(s — 1) . 

t<2{n—s) / (s—l) 

We now analyze error in two cases. The first case is that x* is never eliminated, and thus x* 
participates in Step 3. Theorem 13.II then ensnres that the final output is of value at least x* — 2. 
Otherwise, consider the iteration when x* is eliminated. In this iteration, it must be the case that 
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the X chosen in Step 2(b) has x > x* — 1, and thus any element with value less than x* — 2 was 
also eliminated in this iteration. In this case all future iterations only contain elements of value at 
least X* — 2, and so again the final output has value at least x* — 2. ■ 

The key recursion step of our general error max-finding algorithm is the algorithm 1-Cover 
(given in Lemma 13.51) which is based on 2-MaxFind and the following lemma. 

Lemma 3.4 There is a deterministic algorithm which makes ( 2 ) comparisons and outputs a 1- 
max-set of size at most [logn]. 

Proof. We build the output set in a greedy manner. Initialize 5 = 0. At each step consider 
the subtournament on the vertices T defined to be those vertices neither in S nor defeated by an 
element of S. An averaging argument shows there exists an element in T which wins at least half 
its matches in this subtournament; add this element to S. Note in the next step |r| decreases by 
a factor of at least 2, so there are at most [logn] iterations. Furthermore, at least one element in 
the final set S must either have value x* or have defeated x*, and thus 5 is a 1-max-set. ■ 

We now obtain 1-Cover by setting s = [2-y/rr| in Figured] then returning the union of the x that 
were chosen in any iteration of Step 2(a), in addition to the output of Lemma 13.41 on the elements 
in the hnal tournament in Step 3. 

Lemma 3.5 There is an algorithm 1-Cover making at most 3 • comparisons which finds a 
1-max-set of size at most ^/n (for n > 81). 

Proof. Run the algorithm 2-MaxFind with s = [2yTjr|. Return the set consisting of all elements that 
won the round-robin tournament in Step 2(b) of Figured] in at least one iteration, in addition to a 
size- [log s] set 1-greater than the candidate elements which were left in Step 3 (using Lemma 13.4p . 
The total size of the returned set is thus [n/s] — 1 -|- [logs] < \^/n/2'] + [log([2-y/n])] — 1. For 
ri > 81, this is at most y/n. 

To show correctness, consider the element x* of maximal value. Either x* was eliminated in 
Step 2(c) of some iteration, in which case the element x that eliminated x* had value at least 
X* — 1, or X* survived until the last iteration, in which case the set constructed via Lemma 13.41 is a 

1- max-set. Finally, note that the number of comparisons is the same as the number of comparisons 

used by 2-MaxFind (with the same s) and therefore is less than 3ri^/^. ■ 

We are now ready to give our main algorithm for finding a A:-max, shown in Figure [2] 

Theorem 3.6 For every 3 < k < log log n, k-MaxFind uses ^-i)) comparisons and 

finds a k-max. 

Proof. We prove that for any 2 < k < loglogn, Ac-MaxFind uses at most 54 • 7i3-2*’/(3'2''-4) _ 
54 • comparisons and finds a fc-max by induction. First, by Lemma 13.31 it holds for 

2 - MaxFind. 

We now prove the bound on the error. Let x be the element returned by fc-MaxFind. By the 
inductive hypothesis, for every y S x >fc_i y. In addition, for every input element Xj there 

exists y G Ti for some i such that y >1 Xj. Therefore, x >k Xj for every j G [nj. 

The total number of comparisons used by fc-MaxFind can be bounded as follows. 


Algorithm /c-MaxFind: // Returns a /c-max for k > 3 

1. If n < 81 return the output of 2-MaxFind on the input elements. 
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2. Equipartition the n elements into sets Si, ... ,St each of size r = max{81,4 • n3-2'‘-4} 

3. Call 1-Cover on each set Si to recover a set Ti 1-greater than Si. 

4. Return (fc — l)-MaxFind(U*^;^Tj) // Recursion stops at 2-MaxFind. 


Figure 2: The algorithm fc-MaxFind for finding a fe-max. 

• if n < 81 then 4 • < 36 • n. Otherwise, 

• t = n/r invocations of 1-Cover. By Lemma 13.51 this requires at most 3 • ■ njr = 3^/r ■ n 

3-2*^ 3 A 

comparisons which equals max{27 • n, 6 • n3'2'=-4}, Note that n3-2'“-4 > n and therefore we 

3-2*^ 

can use 27 • n3'2'=-4 as an upper bound. 

• The invocation of {k — l)-MaxFind on By Lemma 13.51 the size of each Tj is at most 

3-2*=-S 

y/r. Therefore, | Tj| = y/r ■ n/r = niy/r < ^2. By, the inductive assumption this 

invocation requires at most 

54 . f n3-2*-4 /2 ) < 27 • n3-2'=-4'3.2*:-l-4 = 27 • n3'2'=-4 . 


3 A 

Altogether the number of comparisons is at most max{36 • n, 54 • n3'2'=-4 


3 - 2 ^ 

} = 54 . n3-2''-4. ■ 


Corollary 3.7 There is a max-finding algorithm using 0(n) comparisons with error of at most 
log logn. 

3.2 Randomized Mcix-Finding 

We now show that randomization can significantly reduce the number of comparisons required 
to find an approximate maximum. Our algorithm operates correctly even if the adversary can 
adaptively choose how to err when two elements are close (though we stress that the adversary 
may not change input values over the course of an execution). In particular, the classic randomized 
selection algorithm can take quadratic time in this adversarial model since for an input with all 
equal values, the adversary can claim that the randomly chosen pivot is smaller than all other 
elements. Nevertheless, even in this strong adversarial model, we show the following. 
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Algorithm SampledTournament: // For constant c and n sufficiently large, 

returns a 1-max-set with probability at least 1—n“‘^. 

1. Initialize Nq •(— {xi, ..., Xn}, VK •(— 0, s •(— 15(c + 2) + 1, C •(— 4^/(5e)^, and i •(— 0, 
where e is Euler’s number. 

2. if m < ((c + 1)/C')n^/^ Inn, add elements of Aj to IE and return W. 

3. else add a random subset of ((c + 1)/C')n^/^ Inn elements from Aj to IE. 

4. Randomly partition the elements in Aj into sets of size s. In each set, perform a 
round-robin tournament. 

5. Let Aj+i contain all elements of Aj which had strictly fewer than (s — 2)/4 losses in 
their round-robin tournament in Step 01 Increment i and goto Step [21 


Figure 3: The algorithm SampledTournament. 

Theorem 3.8 For any integer c > 1, there exists a randomized algorithm which given any n 
elements finds a 3-max of the set with probability at least 1 — using at most {s — l)n + ((c + 
l)/(Cln2))^/2 • n^/^ln^n = 0{n) comparisons, where s,C are as defined in Figure\^ 

Taking c > 1, and using the fact that the error of our algorithm can never be more than n — 1, this 
gives an algorithm which finds an element with expected value at least x* — 4. The high-level idea 
of the algorithm is as follows. We randomly equipartition the elements into constant-sized sets. In 
each set we play a round-robin tournament and advance everyone who won more than 3/4 of its 
comparisons. As we will prove, the element with the median number of wins can win at most 3/4 
of its comparisons and hence no more than half of the elements advance. We also randomly sample 
a set of elements at each level of the tournament tree. We show that either (1) at some round 
of the tournament there is an abundance of elements with value at least x* — 1, in which case at 
least one such element is sampled with high probability, or (2) x* advances as one of the top few 
tournament elements with high probability. Figure |3| presents the subroutine SampledTournament 
for the algorithm. 

We now proceed to the analysis of our algorithm. First we show that the element with the 
median number of wins (or the element of order [n/2] when sorted in increasing order by number 
of wins) must incur a significant number of losses. We in fact show that it must also incur a 
significant number of wins, but we will not need this latter fact until presenting our selection and 
sorting algorithms. 

Lemma 3.9 In a round-robin tournament on n elements, the element with the median number of 
wins has at least m wins and at least m losses for m = |'(|'n/2] — l)/2] > [n/S]. 

Proof. Sort the elements by their total number of wins and let x' be the median according to the 
number of wins. Let I denote the number of wins of x'. Assume that n is even. Then the total 
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number of wins for all the elements is at most n/2 - ^ + 71/2 • (n — 1) — (” 2 ^) since there are n/2 
elements with at most I wins and the total number of wins by the re/2 elements that have more 
wins than x' is at most re/2 • (re — 1) — (” 2 ^)- But the total number of wins is exactly ( 2 ) ^.nd 
therefore we obtain that t ■ nj2 > (” 2 ^), or £ > (re — 2)/4. The bound on the number of losses is 
obtained in the same way. If re is odd then this argument gives a bound of ([re/2] — l)/2. ■ 

Lemma 3.10 Let s = 15(c + 2) + \,C he as in Figurel^ and let W be the final set output in 
Figure 0. Then for any integer choice of c> 1: 

• |1T| < (c + 1)/(C'ln2) • re^/^ In^ re. 

• W is a l-max-set with probability at least 1 — n~^. 

• The algorithm SampledTournament makes at most (s — l)re eomparisons. 


Proof. By Lemma 13.91 the element with the median number of wins has at least (s — 2)/4 losses 
during each round-robin tournament in Step 0 and thus the fraction of elements that survive from 
one iteration to the next in Step [5] is at most 1/2. Therefore, the number of iterations is at most 
[log 2 re]. In each iteration we sample ((c-l-l)/^)-re^/^ Inre elements, and thus the size of the output 
W is as claimed. Also, the total number of comparisons is at most ( 2 ) ' {'n/T^)/s = {s — l)re, 

where re/2* is an upper bound on |A^i|. 

We now show that IT is a 1-max-set with probability at least 1 — re“‘^. We say that an iteration 
i is good if either x* advances to A^j+i, or W contains a 1-max at the end of round i. We then show 
that for any iteration i, conditioned on the event that iterations 1,... ,z — 1 were good we have 
that i is good with probability 1 — l/re^"*"^. The lemma would then follow by a union bound over 
all iterations i. 

Now consider an iteration i where 1,... ,7 — 1 were good. Then either W already contains a 
1-max, in which case i is good, or W does not contain a 1-max but x* £ Ni. Let us focus on this 
latter case. Define re* = |A^il. Let Qi be the event that the number of elements in W with value at 
least X* — 1 is at least Caui for a = re“^/^. We show a dichotomy: either Qi holds, in which case 
1-max is sampled into W with probability 1 — l/re'^"*'^, or Qi does not hold, in which case x* € Aj+i 
with probability 1 — 

To show the dichotomy, let us first assume Qi holds. Then, the probability we do not sample a 
1-max into W is at most 


1 - 




m 


< 1 - 


re 


C 

T/s 


((c+l)/C)nl/3 Inn 


< g-(c+l)lnn 


1 

^c+1 • 


Now let us assume that Qi does not hold. Then for x* to not advance to A^i+i we must 
have that at least s/5 1-maxes were placed into the same set as x* in iteration i. Using that 
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(a/b)^ < (^) < (ea/b)^, this happens with probability at most 



< rii 


(Cani\ ( rii \ 

\ s/5 ) ' \4s/5) 

K) 


< rii ■ 


e" • i5Cani/sY/^ • (5Cn^/(4s))^"/5 
{rii/sY 

< n* • (e • • 5^/^ • (5/4)^/^ • 


which is at most n by our choice of s and C. ■ 

Proof (of Theorem 13.8p . Run the algorithm in Figure [3l By Lemma 13.101 the output W is 1- 
max-set with probability at least 1 — n“'^. Conditioned on this event, a 2-max of W is thus a 
3-max of the entire original input. A 2-max of W can be found via a round-robin tournament by 
Theorem 13.11 using < |hFp/2 comparisons. The total number of comparisons is thus the sum 
of comparisons made in Figure [3l and in the final round robin tournament, which gives the bound 
claimed in the theorem statement. ■ 


4 Sorting and Selection 

We now consider the problems of sorting and selection. We first present an algorithm 2-Sort which 
sorts with error 2 using 0(n^/^) comparisons (and, in particular can be used for selection with error 
2). We then describe the selection and sorting algorithms for general error k. We start by formally 
defining what is meant by selecting an element of certain order with error. 

Definition 4.1 Element Xj in the set X = {xi,... ,Xn} is of fc-order i if there exists a partition 
'S' 1 , 5'2 of X \ {xj} sueh that |5i| = i — and Si U {xj} <k S 2 U {xj}. A fe-median is an element 
of k-order \n/2]. 

Our error 2 sorting algorithm is based on modifying 2-MaxFind so that the x found in Step 
2(a) of Figure [U is used as a pivot. We then compare this x against all elements and pivot into 
two sets, recursively sort each, then concatenate. More formally, the algorithm 2-Sort works as 
follows. If n < 64 then we just perform a round-robin tournament on the elements. Otherwise let 
s = s(n) = y/^. We choose some s elements and perform a round-robin tournament on them. 
Now let X be an element with the median number of wins. We compare x to all elements and let 
Si be the set of elements that lost to x and S 2 be the set of all elements that defeated x. Then 
we recursively sort 5i and S 2 then output sorted Si, then x, and then sorted S' 2 . Note that any 
( 1 /) y') S (^i U {r}) X S '2 satisfies y' >2 y since y' >1 x and x >1 y. Correctness follows by induction 
from Theorem 13.II We prove the following bound on the number of comparisons used by 2-Sort. 

Theorem 4.2 There is a deterministie sorting algorithm 2-Sort with error 2 that requires at most 
4 • comparisons. 
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Proof. Let g{n) be the worst-case number of comparisons required by 2-Sort that we described 
above. We claim g{n) < 4 • For n < 64 we perform a round-robin tournament and thus 

g{n) = ( 2 ) in this case, which is less than 4-n^/^ for n < 64. Now we consider n > 64. Let t = |S' 2 |. 
The number of comparisons used in a recursive call is at most s{s — l)/2 + n — s + g{n — t — l) + g{t). 
By our inductive assumption this is at most s(s — l)/2 -|- n — s -|- 4((n — t — 1)^/^ -|- Without 

loss of generality we can assume that t < (n — l )/2 and then obtain that this function is maximized 
when t is the smallest possible (via a straightforward analysis of the derivative). By Lemma 13.91 x 
has at least (s — 2)/4 wins and (s — 2)/4 losses and therefore t > {s — 2)/4. Now we observe that 
in — t — 1 )^/^ < + 1 ) (to verify it is sufficient to square both sides and use the fact 

that t < n). Hence 

g{n) < s^/2 + n — 3s/2 -|- 4(n^/^ — ^Vn{t -|- 1) -|- 

< 4 . ^ 3/2 ^ 2 n - 2 V^ - + + ^ 3/4 

2 

= 4 • _ (3/^ _ 2)n - (3 + 3/^2) < 4 • 

The last line of the equation follows from the following application of the inequality of arithmetic 
and geometric means 

{ 3 /V 2 - 2)n + {3 + 3/\/2)v^ > 2^J{3/V2 - 2)(3 -b 3/V2)n^/'^ > . 

This finishes the proof of the induction step. ■ 

At a high level our algorithm for A:-order selection is similar to the classical selection algorithm 
of Blum et al. [5], in that in each step we try to find a pivot that allows us to recurse on a problem 
of geometrically decreasing size. In our scenario though, a good pivot must have an additional 
property which we now dehne. 

Definition 4.3 Element xj in the set X = {xi,... ,Xn} is a k-pivot for m elements if there exist 
disjoint sets C X\{xj} (winning setj and Si C X\{a;j} (losing setj, such that IS'iul = \Si\ = m, 
xi <k Xj for all I € Si, and X£ >k Xj for all i G Sw 

In order to use an element as a pivot in our algorithm it must he a {k — l)-pivot. We construct 
such a pivot via a recursive algorithm that given n elements and a number k constructs a A:-pivot 
for at least n/(5 • 2^“^) elements. For k = 1, Lemma 13.91 gives the desired algorithm. The general 
algorithm is effectively a recursive application of Lemma [3. 9 1 and is described below. Our algorithm 
for selecting an element of /c-order i is in Figure [5j 

We claim that algorithm /c-Select finds an element of fe-order i using at most 0(2^ • ) 

comparisons. To prove this, we first analyze the algorithm fe-Pivot. 

Lemma 4.4 For any 1 < k < log log n, given n elements the deterministic algorithm k-Pivot (see 
Figure^ finds a k-pivot for m > n/(5-2^“^) elements and corresponding losing set Si and winning 
set Sw using at most 9 • -|- Cn comparisons, where Cn = min{( 2 ), (^ 2 ^)}- 
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Algorithm A:-Pivot: // Given a set of n > 3 elements X, returns a fc-pivot 

for m > n/(5 • 2^“^) elements and corresponding losing and winning sets (as 
described in Definition 14 . 3D . 


1. if A: = 1 or n < 215 // Base case 


(a) Perform a round-robin tournament on X. 

(b) Let y be the element with the median number of wins. 

(c) Let m be the smaller of the number of wins and the number of losses of y. 

(d) Let Si be a set of m elements that lost to y and be a set of m elements that 
defeated y. 


2. else 


(a) 

(b) 

(c) 


Set s 



and set s' ^ [ ([ 5 / 2 ] 


Initialize T •(— X, 


0 . 


while \T\ > s 


1 )/ 21 . 


i. i •(— z -b 1. 

ii. Let Xi be a set of s arbitrary elements from T. 
hi. Perform a round-robin tournament on X^. 

iv. Set yi to be the element with the median number of wins. 

V. Set Si^i to be a set of any s' elements that lost to y and Si^w a set of s' 
elements that defeated yi. 
vi. Update T ^T \ [S^ U U {?/*}). 

(d) Set t ^ i and Y ^ {yi,y 2 , ■ ■ 

(e) Recursively call {k — l)-Pivot on Y and let y, S'^ and S'^ be the {k — l)-pivot 
and the sets returned. 


(f) Set Si ^ S', U S^,l and ^ 5^ U >5^ 


3. Return y, Si and Sy,. 


Figure 4; The algorithm /c-Pivot for finding a /c-pivot for at least n/(5 • 2* elements 
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Algorithm /c-Select: // Given a set A of re > 3 elements, returns an element of 
/c-order i in A 


1. if A; < 2 or re < 8, sort elements using 2-Sort then return the element with index i. 

2 . else 


(a) Set s •(— re^ ^ and let T be a set of any s elements from A. 

(b) Call {k — l)-Pivot on T and let ?/, Si and be the pivot and the sets returned. 

(c) Compare y with each of the other re — 1 elements. 

(d) if y defeats at least (re — l)/2 elements 

i. Set Ai to be the set of all elements that y defeats and are not in Syj. 

ii. Set A 2 = A\(AiU{ 2 /}). 

(e) else // the symmetric case 

i. Set A 2 to be the set of all elements that y lost to and are not in Si. 

ii. Set Ai = A \ (A 2 U{y}). 

(f) if I All = i — 1 return y. 

(g) else if i < |Ai|, return the output of A:-Select for an element of fe-order i in Ai. 

(h) else return the output of /c-Select for an element of /c-order (i — |Ai| — 1) in A 2 . 


Figure 5: The algorithm /c-Select. 
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Proof. We prove that for any 1 < k < log log n, A:-Pivot uses at most 9 • + Cn 

comparisons and finds a fc-pivot for m > n/{5 ■ 2^“^) elements by induction. First, if A; = 1 
or n < 215 then by Lemma 13.91 it holds for 1-Pivot since m > n/5 and the total number of 
comparisons n(n — l)/2 < 9 • -|- Cn- 

We now prove the bound on the error in the general case when k >2 and n > 216. Let y be 
the element returned by fc-Pivot. By the inductive hypothesis, for every v G Si, v € S'^ then 
V <k-i y- Otherwise, when v € Si^i for some yi G S'l we get that v <i yi and yi <k-i y- This 
implies that in both cases v <k y- Similarly, for every v G Sw, v >k y- 

Next we prove the bound on m. The algorithm performs a round-robin on s elements until at 
most s — 1 elements are left and each such round eliminates exactly 2s' + 1 elements. Therefore the 
number of rounds t is at least > [(n — s -|- l)/(2s' -|- 1)]. By the inductive hypothesis. 


m 


= |S;i = 


S'J>t/{5-2^-^)> 


n — s + 1 


5 • 2*^-2 • (2s' -P 1) 


Now, 


m = m' ■ {s' + 1) > 


n — s -p 1 
2s'-Pl 


s'+ 1 
5 • 2^-2 


n n — 2(s — l)(s' -P 1) 
5 • 2*^-1 5 • 2'=-! • (2s' -P 1) 


If s < 19 then n > 216 implies that n—2(s—l)(s'-pl) > 0. Otherwise (for s > 20), k >2 implies that 
s < [S • and therefore, n > ((s — l)/3)^. By definition of s', s' = |'(|'s/2] — l)/2] < (s -P l)/4. 

Therefore, for s > 20, 


n-2(s-l)(s'-Pl) > 



s^ -P 4s -P 5 
2 


> 0. 


Hence m = IS*/] = |5^„| > gT^vr- 

Finally, we prove the bound on the total number of comparisons used by /c-Pivot when k >2 
and n > 216 as follows: 


• t < [n/(2s' -p 1)J invocations of round-robin on s elements. By dehnition 2s' -P 1 > s/2 and 

therefore this step requires at most [ 2 n/sJ s(s —l )/2 < n(s — 1 ) < -i) comparisons. 

• The invocation of {k — l)-Pivot on t < [2n/sJ elements. By our inductive hypothesis, this 

requires + ct < 9(2 • + Cn < 6 • + Cn- 

Altogether the number of comparisons is at most 9 • -p Cn, as was claimed. ■ 

We are now ready to state and prove our bounds for /c-Select formally. 


Theorem 4.5 For any 2 < k < log log n, there is a deterministic algorithm k-Select which, given 
n elements and i G [n], finds an element ofk-order i using at most 25-2^“^n^'’'^ -p5-2^^“^n^ Cn 


comparisons, where Cn 


““{( 2 )>( 2 )} (as defined in Lemma \4fi^ - 


Proof. We prove the claim by induction on n. For n < 8 we use 2-Sort which sorts with error 2. 
An element i in such a sorting has 2-order i. Also, according to Theorem 14.21 the algorithm uses 
at most 4 n ^/2 < 25 • 2^~^ ■ comparisons. 
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We now consider the general case when n> 9 and k >3. If y defeats at least (n — l)/2 elements 
then for every element zi G Xi, zi <i y and, by the properties of the {k — l)-pivot for every element 
Z 2 in X 2 , y <fc-i Z 2 - In particular, zi <k Z 2 - Now, if |Xi| = i — 1 then Xi and X 2 form a partition 
of X \ {y} showing that y is an element of fe-order i. If |Xi| > i — 1 then let y' be the fe-order i 
element in Xi returned by the recursive call to /c-Select. There exists a partition of Xi into sets 
and S 2 showing that y' is an element of /c-order z in Xi. We set Si = S{ and S 2 = S' 2 U{y}UX 2 . 
First, by the definition of y', for every G 5i U {y'}, and Z 2 G S 2 U {y'} we have zi <k z' 2 - Now, 
by our choice of y we know that for G S'! U {y'} and Z 2 G X 2 U {y} we have zi <k 22 - Hence 
Si U {y'} <k S 2 U {y'}, that is, y' is an element of fe-order i. The case when |Xi| < z — 1 and the 
symmetric case when y lost to at least (n — l)/2 are analogous. This proves that fc-Select returns 
an element of /c-order z. 

Finally, in the general case, the number of comparisons A:-Select uses is as follows. 


Call to {k — l)-Pivot on s = 


n 


1 - 2 ^ 


— — 3 elements. Lemma 14.41 implies that this 


step uses at most ^ 1 ) _|_ comparisons. 


• Comparison of the pivot with all the elements uses at most re — 1 comparisons. 


• The invocation of A:-Select on one of Xi and X 2 . By the definition of pivot, \Su,\ = \Si\ < 
(s — l)/2 < (re — 2)/4. Hence we observe that if y defeated at least (re — I)/2 elements then 
|Xi| > (re —1)/2 —IS^I > (re —2)/4> \Si\. And by the definition of X 2 , IX 2 I > \Sw\- Similarly, 
if y lost to at least (re — l)/2 elements then |Xi| > IS";! and IX 2 I > ISu;!- Assume, without loss 
of generality, that |Xi| > IX 2 I and let a = (|X 2 | + I)/re. By the properties of the (fc —I)-pivot, 


IX 2 I >s/(5-2 


k-2\ 


> 


re 


1-2^ 


/(5 • 2''-") > re 


,1-2^ 


7(5-2' 


k-2\ 


- 1 , 


or a > re“^^ */(5-2^~^). The number of comparisons is maximized when /c-Select is executed 
on Xi which has size re — IX 2 I — 1 = re — an and, by our inductive hypothesis, this step can 
be done using N comparisons for 


X < 25 • 2^-^ (re - are)^+^' " + 5 • 2^^-^ ■ (re - anf^ " • c„ 

<25 • 2^-1 • rei+2^"'' (1 - + 5 • • re^^"'' • (I - af''^ • 

<25 • 2^-1 • rei+2^''' (1 - a) + 5 • 2^^-^ • • (1 - 2^-^ ■ a) ■ 

=25 • 2^-^ ■ re^+2'"'' + 5 • 2^^-^ ■ Cn - 10 • re - Cn 


Therefore altogether the number of comparisons is at most 25-2^ ^ • re 


fc-l .,^1+21 


+ 5 


,22A:-3.re2l 


We now show that with a small change our selection algorithm can be used to produce a complete 
sorting with error k. Namely, instead of running recursively on one of the subsets Xi and X 2 , we 
recursively sort each partition, then concatenate the sorted results in the order /c-Sort(Xi), y,A;- 
Sort(X 2 ). As expected, in the base case (when re < 8 ) we just output the result of 2-Sort. We 
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claim that the resulting algorithm, to which we refer to as fc-Sort, has the following bounds on the 
number of comparisons. 


Theorem 4.6 For any 2 < k < log log n, there is a deterministic algorithm k-Sort which given a 
set X of n elements, sorts the elements of X with error k and uses at most 7 ■ 2 
comparisons, where Cn = min{( 2 ), (^ 2 ^)} (o-s defined in Lemma\4^- 


2k . ^1+2^ 


+ n-c„ 


Proof. As before, we prove the claim by induction on n. For n < 8 we use 2-Sort which produces 
sorting with error 2 and gives a suitable bound on the number of comparisons. 

We now consider the general case (n > 9 and k > 3). As in the case of selection, it is easy to 
see that the algorithm sorts X with error k. However the bound on the number of comparisons 

gorithm is called recursively on 


n 


1 - 2 ^ 


elements uses at most 


is different from the one we gave for k-Select since now the al; 
both Xi and X 2 . As before, the call to (k — l)-Pivot on s = 

9s1+i/(2''-1-i) + <9n + Cn comparisons and there are at most n — 1 comparisons of the pivot 

with all the other elements. We again assume, without loss of generality, that |Ali| > IA 2 I and 
denote a = {\X 2 \ + 1)/^. By our inductive hypothesis, the number of comparisons N used for the 
recursive calls is bounded by 


N <7 -2^^ 
= 7-2^’^ 


n — an) 


1-1-21 


+ (an) 


1-1-21 


+ Cn((n — an) + {an — 1)) 


• n 


1-1-21 


^(1 - a)^+^^ + {n- l)cn . 


( 1 ) 


By differentiating the expression (1 — as a function of a we obtain that it is 

monotonically decreasing in the interval [0,1/2] and hence its minimum is attained when a is the 
smallest. Therefore we can use the lower bound a > /(5 • 2^“^) to conclude that 


(1 - a) 


1 + 2 ^ 


+ a 


1 + 2 ^ 


< (1 — a)(l — a)^^ 
= 1 - (1 - a) -2^-^ 


+ a < (1 — a)(l — 2^ ^ ■ a) + a 

k-2\ 


9 

" - “10 




/(5 • 2^-^) 


= 1 - 2 ^ 

25 


n 


By substituting this bound into equation ([T]) we obtain that 


N <7-2^^ ■ 


1-2 

25 


2 - 2fc^-2 


+ {n- l)c„ = 7-2 


2fc ^1+2^ 


+ n - Cn — lOn — Cn 


Therefore altogether the number of comparisons used by /c-Sort is at most 7 • 2^^ • n^"*"^ 


+ n-c„ 


An immediate corollary of Theorem 14.61 is that it is possible to achieve error of no more than 
log log n in close to optimal time. 

Corollary 4.7 There is a sorting algorithm using O(ralog^n) comparisons with error of at most 
log logn. 
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5 Lower Bounds 


Here we prove lower bounds against deterministic max-finding, sorting, and selection algorithms. 
In particular, we show that Theorem 13.61 Theorem 14.51 and Theorem 14.61 achieve almost optimal 
trade-off between error and number of comparisons. 

Our proof is based on the analysis of the comparison graph, or the directed graph on all elements 
in which an edge {xi , Xj ) is present whenever a comparison between Xi and Xj was made and its 
imprecise outcome was “xj > x/’. We show that one can only conclude that Xj >k xj if this 
graph has a path of length at most k from Xj to Xj. The existence of short paths from an element 
to numerous other elements (such as when the element is a fc-max) is only possible when there 
are many vertices with large out-degree. Following this intuition we define an oracle that when 
comparing two elements always responds that the one with the smaller out-degree is larger than 
the one with the larger out-degree. Such an oracle will ensure that a large number of comparisons 
needs to be made in order to obtain a sufficient number of vertices with high out-degree. We also 
show that the responses of the oracle can be seen as derived from actual values defined using the 
resulting comparison graph. 

Lemma 5.1 Suppose a deterministic algorithm A upon given n elements guarantees that after 
m comparisons it can list r elements, each of which is guaranteed to he k-greater than at least q 
elements. Then m = ^)}). 

Proof. To create a worst case input we first define a strategy for the comparator and later choose 
values for the elements which are consistent with the given answers, while maximizing the error of 
the algorithm. 

Let Gt be the comparison graph at time t. That is, Gt is a digraph whose vertices are the Xj and 
which contains the directed edge {xi,Xj) if and only if before time t a comparison between x* and 
Xj has been made, and the comparator has responded with “xj > Xj”. We denote the out-degree 
of Xi in Gt by dt{xi). Assume that at time t the algorithm wants to compare some Xj and xj. If 
dt{xi) > dt{xj) then the comparator responds with “xj > Xj”, and it responds with “xj > Xj” 
otherwise. (The response is arbitrary when dt{xi) = dt{xj).) Let x be an element that is declared 
by A to be /c-greater than at least q elements. 

Let £i = dist(x, Xj), where dist gives the length of the shortest (directed) path in the final graph 
Gm- If no such path exists, we set it = n. After the algorithm is done, we define val(xj) = it. We 
first claim that the values are consistent with the responses of the comparator. If for some pair of 
elements Xi,Xj the comparator has responded with “xj > Xj”, then Gm contains edge {xi,Xj). This 
implies that for any x, dist(x,Xj) < dist(x,Xj) -|- 1, or it > £j — 1. Therefore the answer “xj > Xj” 
is consistent with the given values. 

Consider the nodes x* that x can reach via a path of length at most k. These are exactly the 
elements /c-smaller than x, and thus there must be at least q of them. For i < k let Si = {xj \ ij = i} 
and Si = |S'il. We claim that for every i £ [A:], m > s^/{2si-i) — Sif2. For a node u € Si, let pred(rt) 
denote some node in Si-i such that the edge (pred(u),tt) is in the graph. For a node v € Si-i, let 
Si,v = {u £ Si \ V = pred(M)}. Note that each node u £ Si has a single designated pred(M) £ 5j_i 
and hence are disjoint. Further, let dQ^|;(pred(M), u) be the out-degree of pred(rt) when the 


19 


comparison between pred(u) and u was made (as a result of which the edge was added to Gm)- 
Note that for any distinct nodes u, u' G 5*^^, dout(^j '^) ^out(^! since the out-degree of v grows 

each time an edge to a node in is added. This implies that 

^OUt(^’^) — l'S'i,t;|(|*S'i,.ul — l)/2 . 


By the definition of our comparator, for every u G Si, dm{u) > c?out(P^®'^(^)! ^)- This implies that 


m > 


E 

v£Si-i u£Si 


yy dm{u) > 


E 

v&Si-i 




Using the inequality between the quadratic and arithmetic means, 

v&Si-i \vGSi-i / 

This implies that m > ^ — y. 

We can therefore conclude that Si < {2m + Sj)sj_i < y/‘imsi-i since Si < n < m. By applying 

this inequality and using the fact that sq = 1 we obtain that sf/3 < m and Sj < 3m- (3m/si)^ 
for f > 1. Since Sj > g -|- 1, we thus find that g < 12 • m • (3m/si)^ This holds since 

either 

1 . (3m/si)^ > 1/2 and then 12 • m • (3m/si)^ > 6m > n, or 

2 . (3m/si)“^ < 1/2 and then 

(3m/si)“^ *^V(3m'/'Si)~^ * = (3m/si)“^ * < (3m/si)“^ < 1/2 


for i < k — 1, where the penultimate inequality holds since si < 3m. In this case 


k k 

q — Si < y^ Si < yy(3m)(3m/si)“^ ^ ' 

i=2 i=2 


< y^2*-^(3m)(3m/si)-2 

i<k 

sl_2-('=-l) 2-('=-P 

< 2(3m) 


If Si > q/2, then m = since m > s^/3. Otherwise we have that 


implying 

m = f 2 (max{s 2 ,gV(i- 2 -('=-P)/,i/( 2 ('“-^)-i)|) ^ ^(^i+i/( 2 '=-i))^ 
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where the final equality can be seen by making the two terms in the max equal. 

Also, note that the choice of x amongst the r elements of the theorem statement was arbitrary, 
and that si is just the out-degree of x. Let Smin be the minimum out-degree amongst the r elements. 
Then we trivially have m > r ■ Smin- Thus, if Smin ^ 9/2 then m > qr/2, and otherwise 

m = Q{max{r ■ 

where the hnal equality is again seen by making the two terms in the max equal. ■ 

From here a a lower bound for max-finding by setting r = 1, q = n — 1, and for median-hnding 
and sorting by setting r = q = n/2. The sorting lower bound holds for fc-order selection of the 
jth giej^ient for any i = c - n for constant 0 < c < 1. More generally, selecting an element of order 
i > n/2 requires n(z • max{z^/*'^ )}) comparisons. For i < n/2 we obtain the lower 

bound of fl((n — i) ■ max{(n — ^)}) by considering the symmetric problem. 

Theorem 5.2 Every deterministic max-finding algorithm A with error k requires 
comparisons. 

Theorem 15.21 implies that /c-Sort and A:-Select are optimal up to a constant factor for any constant 
k. 

Theorem 5.3 Every deterministic algorithm A which k-sorts n elements, or finds an element of 
k-order i for i = c - n with 0 < c < 1 a constant, requires ) comparisons. 

In addition we obtain that Corollary 13.71 is essentially tight. 

Corollary 5.4 Let A he a deterministic max-finding algorithm that makes 0{n) comparisons. Then 
A has error at least log log n — 0(1). 

6 Conclusions 

We dehned a simple and natural model of imprecision in a result of a comparison. The model is 
inspired by both imprecision in human judgement of values and also by bounded but potentially 
adversarial errors in sporting tournaments. Despite the basic nature of the model and the vast 
literature on sorting and searching with faulty comparisons we are not aware of any prior efforts 
to address this type of errors. Our results show that there exist algorithms that are robust to 
imprecision in comparisons while using substantially fewer comparisons than the naive methods. For 
deterministic algorithms our problem can equivalently be seen as finding a A:-king in any tournament 
graph (or sorting elements so that each element is a /c-king for vertices of lower order) while 
minimizing the number of edges checked. Our results generalize previous work on this problem 
that considered the case of A: = 2 [26]. 

We note that in most of the results substantially tighter constants can be obtained in the bounds 
using small modifications of the algorithms, more careful counting and optimization for small values 
of k and n. This would yield algorithms that improve signihcantly on the naive approach even for 
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small values of n. We made only a modest effort to improve the constants to make the presentation 
of the main ideas clearer. 

While our lower bounds show that many of the algorithms we give are essentially optimal a 
number of interesting and natural problems are left open. 

1. What is the complexity of deterministic maximum finding with error 2? 2-MaxFind uses 

comparisons whereas our lower bound is comparisons. Resolving the case of 

A; = 2 is likely to lead to closing of the gap for larger error k. 

2. Can error 2 be achieved by a randomized algorithm using 0{n) comparisons? SampledTournament 
only guarantees error 3. 

3. For randomized algorithms it is also natural to consider the expected error of an algorithm. 
What is the lowest expected error that can be achieved using a randomized algorithm for 
the tasks considered in this paper? Note that in the example presented for the proof of 
Theorem [321 choosing a random element would give a maximum element with expected error 
of 1 and this is the best possible in this example. 

4. We have not addressed the complexity of randomized sorting with error k. 
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